Adaptive Transform Coding Using LMS-like Principal Component Tracking

A new set of algorithms for transform adaptation in adaptive transform coding is presented. These algorithms are inspired by standard techniques in adaptive nite impulse response (FIR) Wiener ltering and demonstrate that similar algorithms with simple updates exist for tracking principal components (eigenvectors of a correlation matrix). For coding an N -dimensional source, the transform adaptation problem is posed as an unconstrained minimization over K = N(N 1)=2 parameters, and this for two possible performance measures. Performing this minimization through a gradient descent gives an algorithm analogous to LMS. Step size bounds for stability similar in form to those for LMS are proven. Linear and xed-step random search methods are also considered. The stochastic gradient descent algorithm is simulated for both time-invariant and slowly-varying sources. A \backward-adaptive" mode, where the adaptation is based on quantized data so that the decoder and encoder can maintain the same state without side information, is also considered. EDICS Category: SP 2. Digital Signal Processing SP 2.6 Adaptive Filters SP 2.6.2 Algorithms (Gradient-Descent, RLS, Random Search, Genetic) Corresponding author: Vivek K Goyal e-mail: [email protected] 211-79 Cory Hall #1772 voice: +1 510 643 5798 Berkeley, CA 94720-1772 fax: +1 510 642 2845 Permission to publish this abstract separately is granted. January 8, 1998 Submitted to IEEE Trans. Sig. Proc. GOYAL & VETTERLI: ADAPTIVE TRANSFORM CODING USING LMS-LIKE . . . 2